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Abstract 

Background: The number of people with dementia is rising rapidly as a consequence of the greying of the world 
population. There is an urgent need to develop cost effective approaches that meet the needs of people with 
dementia and their family caregivers. Depression, feelings of burden and caregiver stress are common and serious 
health problems in these family caregivers. Different kinds of interventions are developed to prevent or reduce the 
negative psychological consequences of caregiving. The use of internet interventions is still very limited, although 
they may be a cost effective way to support family caregivers in an earlier stage and diminish their psychological 
distress in the short and longer run. 

Methods/design: A pragmatic randomized controlled trial is designed to evaluate the effectiveness and 
cost-effectiveness of 'Mastery over Dementia', an internet intervention for caregivers of people with dementia. The 
intervention aims at prevention and decrease of psychological distress, in particular depressive symptoms. The 
experimental condition consists of an internet course with 8 sessions and a booster session over a maximum 
period of 6 months guided by a psychologist. Caregivers in the comparison condition receive a minimal 
intervention. In addition to a pre and post measurement, an intermediate measurement will be conducted. In 
addition, there will be two follow-up measurements 3 and 6 months after post-treatment in the experimental 
group only. To study the effectiveness of the intervention, depressive symptoms are used as the primary outcome, 
whereas symptoms of anxiety, role overload and caregiver perceived stress are used as secondary outcomes. To 
study which caregivers profit most of the internet intervention, several variables that may modify the impact of the 
intervention are taken into account. Regarding the cost-effectiveness, an economic evaluation will be conducted 
from a societal perspective. 

Discussion: This study will provide evidence about the effectiveness and cost-effectiveness of an internet 
intervention for caregivers. If both can be shown, this might set the stage for the development of a range of 
internet interventions in the field of caregiving for people with dementia. This is even more important because 
future generations of caregivers will be more familiar with the use of internet. 

Trial registration: NTR-2051/RCT-DDB 
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Background 

In a recent report on the global economic impact of de- 
mentia [1], costs of dementia are estimated to be slightly 
over US$600 billion pro year worldwide. Costs include 
direct medical costs, direct costs of social care and costs 
attributed to informal care. As a consequence of the 
growing number of dementia patients, costs will rise in 
the future. Alzheimer's Disease International has tenta- 
tively estimated an 85% increase in costs in 2030, based 
only on predicted increases in the number of people 
with dementia. As a consequence, there is a strong plea 
to invest in research and the development of cost effect- 
ive approaches that meet the needs of people with 
dementia and their caregivers across the course of the 
illness. 

Most people with dementia live at home and are cared 
for by their spouses, children or other family members. 
These caregivers play a crucial role in the quality of life 
and quality of care of their family members. Caring for a 
spouse with dementia can be a highly stressful experi- 
ence associated with negative caregiver outcomes such 
as high rates of burden, psychological morbidity, depres- 
sion and poorer immune function [2,3]. Different kinds 
of interventions have been developed for caregivers of 
people with dementia [4-7]. The majority of these inter- 
ventions consists of psycho-educational programs pro- 
viding information on dementia and the consequences 
for daily living, how to cope with related problems, 
which services are available and how to get help. 

Research has shown that particular types of interven- 
tions are effective. One of the main characteristics of 
effective interventions is a psychological rather than 
purely educational approach [8]. Psychological treatment 
is aimed at improving caregivers' abilities to cope with 
problem behavior or stressful situations or to enhance 
communication skills and asking support from others 
[9]. A recent review shows that psychological therapies 
and psychosocial interventions may be a potentially cost 
effective approach to improve outcomes and quality of 
life in both people with dementia and their family care- 
givers [10]. 

Several meta-analysis of randomized controlled trials 
on the effectiveness of internet interventions for depres- 
sion or anxiety focusing on other target groups such as 
younger adults with depression, show that interventions 
are effective [11-14], even more if therapist support is 
part of the intervention [15]. There is also growing evi- 
dence that internet-based interventions are cost effective 
[16]. Family caregivers may favor internet interventions 
instead of meeting in a group or meeting with a profes- 
sional face-to-face, due to lack of time or preferences 
concerning privacy. Caregivers may also be unwilling to 
visit a mental health care institute for themselves be- 
cause in their view they are not the ones who need help. 



Given the growing internet sophistication of middle aged 
and older adults, it is expected that the number of poten- 
tial users of internet interventions will grow substantially. 

Until recently internet-based interventions were not 
developed for family caregivers of people with dementia. 
In November 2008, the innovative eMental Health inter- 
vention for family caregivers of people with dementia, 
called 'Mastery over Dementia! was launched in the 
Netherlands (for an English demo: www.masteryoverde- 
mentia.com). In this paper the design of the RCT to evalu- 
ate the effectiveness and cost-effectiveness of 'Mastery 
over Dementia' for caregivers of people with dementia will 
be described. The specific research questions are: 

1. Is 'Mastery over Dementia' superior compared to 
'care as usual' in terms of a clinically significant 
reduction in depressive symptoms, symptoms of 
anxiety, role overload and caregiver perceived stress? 

2. Are effects maintained up to six months after ending 
the internet intervention? 

3. Which caregivers respond best to the intervention 
compared to others? 

4. Is the internet intervention cost effective from a 
societal perspective compared to the comparison 
group? 

Methods and design 

To evaluate the effectiveness of 'Mastery over Dementia! 
we carry out a pragmatic randomized control trial (RCT). 
In the RCT there are two parallel groups. The experi- 
mental condition in which caregivers take part in the 
intervention (Mastery over Dementia) will be compared 
with a comparison condition in which caregivers receive 
a 'minimal intervention'. The study protocol, informa- 
tion brochure and informed consent procedure were 
approved by the Medical Ethics Committee (METIGG, 
CCMO: NL27434.097.09). 

Recruitment 

Participants are recruited in several ways: the website it- 
self, the monthly digital newsletter of the Alzheimer's So- 
ciety in the Netherlands, leaflets at meetings of Alzheimer 
Cafes and information letters to memory clinics and 
other relevant care institutions. Participants are invited 
to fill in a first short questionnaire on the website. This 
questionnaire serves as a screening tool on the basis of 
which can be decided if participants are suitable for 
treatment. Caregivers will be included with a score > 4 
on the Center for Epidemiological Studies-Depression 
scale, or a score > 3 on the HADS-A, or a minimum 
score of 6 on a one item burden scale ranging from 
0-10. Caregivers with high scores on the CES-D and the 
HADS-A or having suicidal thoughts, were first con- 
tacted by an elderly care physician. 
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Randomization 

Randomization into two groups (experimental group 
and comparison group) takes place after assessment. Be- 
fore randomization participants are stratified on the 
basis of two factors (sex: male/female and relationship: 
spouse/other). As a method for randomization block 
randomization with variable sizes is used. The allocation 
schedule is made with a computerized random number 
generator by an independent researcher and is unknown 
to the investigators of this study. 

Interventions 
Experimental condition 

The intervention 'Mastery over Dementia' was developed 
by the Netherlands Institute of Mental Health and Addic- 
tion in collaboration with a specialized Dutch health care 
provider (Geriant) and the Alzheimer's Society in the 
Netherlands (Alzheimer Nederland) [17]. The program 
offered is a combination of evidence-based support strat- 
egies: psycho-education, cognitive behavioral therapy, 
problem solving therapy and assertiveness training. Relax- 
ation is also incorporated. During the intervention, care- 
givers are supported on-line by a psychologist (coach) who 
gives feedback on the exercises sent by the caregivers. The 
coach has been trained in cognitive behavioral therapy. 

'Mastery over Dementia' consists of eight lessons and a 
booster session (follow-up). Each lesson consists of in- 
formation, practice rehearsal and some homework. 
Themes covered in the course are, for example: 

- coping with behavioral problems 

- arranging help from others 

- non-helping en helping thoughts 

- communicating problems 

Comparison group 

Caregivers in the comparison group receive a minimal 
intervention. There is no contact with a coach. The inter- 
vention consists of eBulletins with practical information 
about caring for someone with dementia. The bulletins 
are sent by mail according to a fixed schedule. Topics of 
the bulletin do not overlap with the content of 'Mastery 
over Dementia'. Topics covered in the bulletins include: 

- Driving and dementia 

- Holiday breaks 

- Medication and dementia 

- Activities throughout the day 

- Grieving and dementia 

- Safety measures in the home 

Measures and measurement 

There are 3 measurements in both groups. The first meas- 
urement is at baseline (pretest). The second measurement 



takes place halfway during the intervention course (after 
the fourth lesson) or after the receipt of the fourth bulletin 
(comparison group). This is approximately at 3 months 
after baseline. The third measurement (post-test) is con- 
ducted directly after the intervention (about 6 months 
after baseline). Additional measurements for the experi- 
mental group are at three months (9 months after base- 
line) and six months after completion (12 months after 
baseline). All measurements are self- report measures and 
are administered through the Internet. In both conditions 
automated emails are sent to participants asking them to 
fill in the questionnaires. This is repeated when partici- 
pants do not respond within a week, and for a second 
time after two weeks. If participants do not answer a re- 
search assistant contacts them by phone. 

Outcome measures in the RCT 

For an overview of the instruments see Table 1. 

Primary outcome measure: depressive symptoms De- 
pressive symptoms are measured with the Centre for 
Epidemiological Studies Depression scale (CES-D). The 
CES-D is a widely used self-report measure for the 
screening of depressive symptoms, and has also been 
used in research on caregiving. The Dutch version of the 
CES-D [18] is used in this study. It consists of 20 items 
for which subjects rate the frequency of symptoms dur- 
ing the past week. Scores range from 0 (rarely or none 
of the time present [less than 1 day]) to 3 (most or all of 
the time present [5-7 days]). The total score range is 
0-60. Items represent major components of depressive 
symptomatology such as depressed mood, feelings of 
guilt and worthlessness, feelings of helplessness and 
hopelessness, psychomotor retardation, loss of appetite, 
and sleep disturbance. A shortened version of the CES- 
D on internet (not used in this study) was found to be 
reliable in an adult population [19]. 

Secondary outcome measure: anxiety symptoms The 

7-item anxiety subscale (Dutch version) of the Hospital 
Anxiety and Depression Scale [20] is used to measure 
the severity of anxiety symptoms. The Hospital Anxiety 
and Depression Scale (HADS) is an extensively used, 
brief self-report screening scale to investigate the preva- 
lence of depression and anxiety symptoms. The anxiety 
subscale consists of 7 items rated on a scale ranging 
from 0 (not at all) to 3 (a great deal of the time). Total 
score ranges from 0 to 21 with higher scores indicating 
more anxiety. The Dutch version of the HADS shows 
good reliability in normal and clinical Dutch samples [21]. 

Secondary outcome measure: role overload Feelings 
of role overload are measured by means of the Self Per- 
ceived Pressure from Informal Care scale (SPPIC) [22]. 
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Table 1 Overview of instruments (measures) 





Pre-test 




Post-tests 






Intake 


T 

= 1 


T 

= 2 


T 

= 3 


T 

= 4 


T 

= 5 


Outcome measures in the RCT 


- Depressive symptoms: CES-D 


X 




X 


X 


X 


X 


- Anxiety symptoms: HADS-A 


X 




X 


X 


X 


X 


- Role overload: SPPIC 




X 


X 


X 


X 


X 


- Caregiver perceived stress: RMBPC 




X 




X 


X 


X 


Confounders/Modifying variables 


- Perceived control: Mastery Scale 




X 




X 


X 


X 


- Sense of competence: SSCQ 




X 




X 


X 


X 


- Behavioral problems: RMBPC 




X 




X 


X 


X 


- Demographic variables 


X 












- Diagnosis/Duration of symptoms 


X 












- Functional status of person with 
dementia: IQCODE 


X 












Outcome measures in the CEA 


- Quality of life: EQ-5D+C 




X 




X 


X 


X 


- Health care utilization: TIC-P 




X 




X 


X 


X 


- Time spent on caregiving 


X 






X 


X 


X 



CES-D Centre for Epidemiological Studies Depression scale. 

EQ-5D+C EuroQol 5 Dimensions plus Cognition. 

HADS-A Hospital Anxiety and Depression Scale, Anxiety subscale. 

IQCODE Informant Questionnaire on Cognitive Decline in the Elderly. 

RMBPC Revised Memory and Behavioral Problem Checklist. 

SPPIC Self Perceived Pressure from Informal Care scale. 

SSCQ Short Sense of Competence Questionnaire. 

TIC-P iMTA Questionnaires on Costs Associated with Psychiatric Illness. 

The SPPIC consists of 9 items, answers vary from 0 
(totally disagree) to 4 (totally agree). The SPPIC is a 
one-dimensional hierarchical scale; higher scores mean 
more perceived pressure. The items are summed on the 
basis of dichotomized scores (cut off: totally disagree 
and disagree = 0; other answers = 1). Total scores range 
from 0-9. The original study [23] shows that reliability 
is good and that perceived pressure did not differ for 
male and female caregivers, and for spouse and non- 
spouse caregivers. 

Secondary outcome measure: caregiver perceived 
stress The Dutch version [24] of the Revised Memory and 
Behavioral Problem Checklist (RMBPC) [25] is used for 
measuring caregiver perceived stress. The questionnaire 
lists 24 items reflecting a variety of problems caregivers 
can encounter. Respondents have to rate the frequency of 
the occurrence of the specific behavior from 0 (never) to 4 
(always). Each item rated with a score of 1 (seldom) of 
higher, is presented again raising the question how much 
people are stressed by the occurrence of the behavior 
(4-point scale from not at all stressed to very much 
stressed). The Caregiver Reaction Score is calculated as a 
mean score for all items together and additionally can be 
divided in separate reaction scores on depressive behavior 



(9 items), disruptive behavior (8 items) and memory- 
related behavioral problems (7 items). Overall scale reli- 
ability is good [24]. 

Additional measures in the RCT 

Perceived control Perceived control of events and on- 
going situations will be assessed using a translated and 
abbreviated 5-item version of the Pearlin Mastery Scale. 
The original scale has 7 items regarding how much an 
individual perceives having control over things in his or 
her life. The scores per item vary from 0 (totally dis- 
agree) to 4 (totally agree). The Mastery Scale [26] has 
good psychometric properties. Compared to the original 
questionnaire, in the abbreviated version two items 
phrased in a positive way ('I can do just about anything I 
really set my mind to' and 'What happens to me in the 
future mostly depends on me') are left out. This abbre- 
viated version shows good reliability [27]. Items are 
summed for a total mastery score (ranges from 0 to 20) 
with lower scores indicating greater perceived control. 

Sense of competence Caregiver's sense of competence 
will be assessed by means of the Short Sense of Compe- 
tence Questionnaire (SSCQ) [28]. The SSCQ consists of 7 
items. Responses are rated on a 5-point scale with possible 
answers, ranging from totally agree (0) to totally disagree 
(4). The questionnaire has three dimensions: conse- 
quences for personal life of the caregiver (2 items), satis- 
faction with role of the caregiver themselves (2 items) 
and satisfaction with role of the person with dementia 
(3 items). The items are summed on the basis of dichoto- 
mized scores (cut off: totally disagree and disagree = 1; 
other answers = 0). Total score range from 0-7. 

Frequency of reported behavioral problems The 24 

items of the Revised Memory and Behavioral Problem 
Checklist (RMBPC) [25] are used to make an inventory 
of the number of problems family caregivers encounter. 
Respondents have to rate from 0 to 4 the frequency of the 
occurrence of the specific behavior (0 = never; 1 = seldom; 
2 = regularly; 3 = often; 4 = always). The total number of 
behaviors problems (0 - 24) will be calculated as well as 
the total mean score (Behavior Frequency Score). The Be- 
havior Frequency can be subdivided into scores on 
Depression (9 items), Disruptive behavior (8 items) and 
Memory-related problems (7 items). 

Other variables that may act as confounders or modi- 
fying variables will be measured. This concerns the fol- 
lowing demographic characteristics of caregivers: sex, 
age, relationship (spouse, child or other), level of educa- 
tion and living arrangement (living together with care 
recipient). Relevant patients characteristics are: sex, age, 
duration of symptoms (as perceived by caregiver), func- 
tional status (assessed by means of a Dutch translation 
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of a short version of the IQCODE [29]) and living condi- 
tion (independently or within care facility). 

Outcome measures in the economic evaluation 

For an overview of the instruments see Table 1. 

Quality of life Quality of life will be measured using the 
6-item self report instrument EQ-5D+C [30]. The EQ- 
5D+C is an extended version of the EuroQol [31] which 
measures health related quality of life and consists of 
five dimensions (mobility, self-care, main activity, pain 
and mood). The EQ-5D+C adds 'cognition' as a sixth di- 
mension. Each dimension is rated as causing 'no pro- 
blems', 'some problems' or 'extreme problems'. The 
EuroQol valuations appear to have good test-retest reli- 
ability [32]. QALYs will be calculated using the Dutch 
EuroQol tariff to estimate utilities [33]. 

Health care utilization An adapted version of the 
iMTA Questionnaires on Costs Associated with Psychi- 
atric Illness (TIC-P) will be used to measure health care 
utilization and productivity losses [34]. In this study 
both the direct costs related to the person with dementia 
with dementia and the direct costs related to the situ- 
ation of the family caregivers themselves are measured. 
Direct costs will include the number of consultations 
with health care providers (e.g. general practitioner, 
physical therapist, psychologist, medical specialist, etce- 
tera), medication, and admissions to hospitals and other 
institutions. Indirect costs are defined as the productivity 
lost due to absenteeism from paid and unpaid work and 
reduced efficiency at work (presenteeism). 

Time spent on caregiving This is measured by four 
questions tapping several main areas of caregiving 
(household tasks, personal hygiene, transportation out- 
side, finances and administration). Caregivers are asked 
to estimate to total numbers of hours in the past week. 
In addition to this we also collect information on the 
availability of other informal caregivers and volunteers 
and the amount of time these others spent on caregiving 
for the person with dementia. Total amount of time the 
family caregiver spends on providing care and also the 
total amount of time spent by other informal caregivers 
or volunteers is calculated. 

Sample size 

Symptoms of depression are the primary outcome mea- 
sures and are used as starting point for the power calcu- 
lations. A standardized effect size (Cohen's d) of 0.50 is 
considered a relevant treatment effect. Assuming an 
alpha of 0.05 and a statistical power (1-Beta) of 0.80 in a 
two-tailed test, we need 63 respondents in each of the 
conditions. Overall, we need 126 respondents to complete 



the study in total. Because we expect a minimum of 25 
percent of caregivers to drop out during the data collec- 
tion, we will recruit at least 175 caregivers. The numbers 
are calculated in Stata 7.0 (StataCorp 2001). 

Statistical analysis 

All analyses in the RCT-study will be conducted accord- 
ing to the intention to treat principle. Missing data on 
follow-up measurements will be imputed using regres- 
sion imputation. To examine differences between the 
outcomes for experimental and comparison group, 
paired t-tests will be conducted and estimates of effect 
sizes will be calculated. By using multiple regression 
analyses, we can correct for possible confounders. With 
a 'generalized estimated equations' (GEE) analysis the re- 
search question regarding the maintenance of the effect- 
iveness of the intervention will be answered. In addition, 
profiles of caregivers who respond best to the interven- 
tion will be described by means of a multiple regression 
analysis which also contains modifying variables (modi- 
fier analysis). All analyses will be conducted using SPSS 
for Windows, version 19. 

Economic analyses 

This economic evaluation will involve both a cost- 
effectiveness analysis (CEA) and a cost-utility analysis 
(CUA). Incremental cost-effectiveness ratios will be cal- 
culated by dividing the difference in total costs between 
conditions by the difference in average effect size. Be- 
cause we calculate costs over a period of six months, 
correction for inflation is not necessary. Missing data on 
follow-up measurements will be imputed using multiple 
imputation. Bias-corrected and accelerated bootstrap- 
ping with 5000 replications will be used to calculate 95% 
confidence intervals around the mean difference in total 
costs between the treatment groups. Bootstrapping will 
also be used to estimate the uncertainty surrounding the 
ICERs which will be graphically presented on cost- 
effectiveness planes. Cost-effectiveness acceptability curves 
and net monetary benefits will also be calculated. Cost- 
effectiveness acceptability curves show the probability that 
collaborative care is cost effective in comparison with 
usual care for a range of different ceiling ratios thereby 
showing decision uncertainty. Sensitivity analyses will be 
carried out to ascertain the robustness of the findings 
under different scenarios, e.g. under varying values of key- 
variables. 

Discussion 

This study assesses the effectiveness and cost-effectiveness 
of an internet intervention for family caregivers of people 
with dementia. In the context of the fast growing number 
of people with dementia in years to come, there is an 
urgent need to develop cost-effective approaches that 
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meet the needs of people with dementia and their family 
caregivers across the course of the illness. Some family 
caregiver may apply for help in the beginning of the 
course of the illness, others may use the intervention in a 
later stage. The potential effect of the internet intervention 
may act immediately or help people to keep on caring and 
prevent them from developing (more) health problems. 

The RCT-study is conducted in the practical setting of 
a health provider who is specialized in dementia care 
and offers case management and a variety of support 
strategies for persons with dementia and family care- 
givers. Because internet delivered intervention is highly 
structured and leaves little room for the therapist to 
adapt it, in practice the structure remains intact without 
major adaptation [35]. Important advantage of such a 
pragmatic study is that results of the study have a high 
level of generalizibility. 

As is the case with internet therapy (or research studies 
in this domain) in general [36], we expect participants to 
be more highly educated, with a high proportion of them 
having a university degree. It is also rather common that 
clients drop out of (research into) internet therapy. In a 
recent review on dropout from internet-based treatment 
for psychological disorders an average rate of 31% was 
found [37]. Evidence on any specific variables that may 
make an individual more likely to drop out is currently 
limited [37]. In this study we expect some family care- 
givers to drop out for specific disease related reasons like 
admission to an nursing home or death of the person with 
dementia. All together this may have a negative effect on 
the generalizability. 

Primary outcome measure in the RCT is severity of 
depressive symptoms of the family caregiver. Anxiety 
symptoms, feelings of burden and caregiver stress are 
secondary outcomes. In a review article about consensus 
on outcome measures for psychosocial intervention re- 
search in dementia care, some recommendations are 
made for use of specific measures [38]. It is suggested 
that if depression is the primary intervention target, the 
CES-D has potential (although it requires further valid- 
ation across Europe). Also the HADS is mentioned as an 
useful instrument. With regard to measuring feelings of 
burden, authors recommend the use of the Zarit Burden 
Interview (ZBI). This scale has been extensively used in 
intervention studies, however, only a few studies show 
significant changes on this scale. In this study we used 
the Self Perceived Pressure from Informal Care scale 
(SPPIC) which focuses on the aspect of role overload. 
To measure caregiver perceived stress we use the 
Revised Memory and Behavioral Problem Checklist 
(RMBPC). 

In contrast to the CES-D and the HADS, both the 
SPPIC and RMBPC are not often used in a web-based 
manner. This means that scale properties like reliability 



may be influenced. However, research has shown that in 
the case of two scales measuring depression no statisti- 
cally significant differences between paper and internet- 
based administration were found [39]. It is recom- 
mended that format of administration should not be 
changed when repeated measurements are made. Main 
advantage of web-based administration [40] is complete- 
ness and reliability of data (no missing values, no data 
entry errors). Other advantages are time flexibility for 
the family caregivers and low costs. 

In conclusion, we expect that this study can add import- 
ant information to the knowledge base on the effective- 
ness and cost-effectiveness of interventions to reduce 
psychological symptoms in informal caregivers of demen- 
tia persons with dementia. Given the steep rise in the 
number of people with dementia and the crucial role fam- 
ily caregivers play in caring for them, interventions that 
reach family caregivers at an early stage are essential [41]. 
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